Unsupervised Coherent Video Cartoonization with Perceptual Motion Consistency
نویسندگان
چکیده
In recent years, creative content generations like style transfer and neural photo editing have attracted more attention. Among these, cartoonization of real-world scenes has promising applications in entertainment industry. Different from image translations focusing on improving the effect generated images, video additional requirements temporal consistency. this paper, we propose a spatially-adaptive semantic alignment framework with perceptual motion consistency for coherent an unsupervised manner. The module is designed to restore deformation structure caused by spatial information lost encoder-decoder architecture. Furthermore, introduce spatio-temporal correlative map as style-independent, global-aware regularization Deriving similarity measurement high-level features cartoon frames, it captures global beyond raw pixel-value optical flow. Besides, disentangles relationship domain-specific properties, which helps regularize without hurting effects images. Qualitative quantitative experiments demonstrate our method able generate highly stylistic consistent videos.
منابع مشابه
Unsupervised Video Adaptation for Parsing Human Motion
In this paper, we propose a method to parse human motion in unconstrained Internet videos without labeling any videos for training. We use the training samples from a public image pose dataset to avoid the tediousness of labeling video streams. There are two main problems confronted. First, the distribution of images and videos are different. Second, no temporal information is available in the ...
متن کاملUnsupervised Object-Level Video Summarization with Online Motion Auto-Encoder
Unsupervised video summarization plays an important role on digesting, browsing, and searching the ever-growing videos everyday. Despite the great progress achieved by prior works (e.g., the frame-level video summarization), the underlying fine-grained semantic and motion information (i.e., objects of interest and their key motions) in online videos has been barely touched, which is more essent...
متن کاملWyner-Ziv coding of video with unsupervised motion vector learning
Distributed source coding theory has long promised a new method of encoding video that is much lower in complexity than conventional methods. In the distributed framework, the decoder is tasked with exploiting the redundancy of the video signal. Among the difficulties in realizing a practical codec has been the problem of motion estimation at the decoder. In this paper, we propose a mechanism f...
متن کاملMotion-based perceptual quality assessment of video
There is a great deal of interest in methods to assess the perceptual quality of a video sequence in a full reference framework. Motion plays an important role in human perception of video and videos suffer from several artifacts that have to deal with inaccuracies in the representation of motion in the test video compared to the reference. However, existing algorithms to measure video quality ...
متن کاملAn Improved Motion Vector Estimation Approach for Video Error Concealment Based on the Video Scene Analysis
In order to enhance the accuracy of the motion vector (MV) estimation and also reduce the error propagation issue during the estimation, in this paper, a new adaptive error concealment (EC) approach is proposed based on the information extracted from the video scene. In this regard, the motion information of the video scene around the degraded MB is first analyzed to estimate the motion type of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i2.20078